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ABSTRACT 

A network of noisy bistable elements with global time- 
delayed couplings is considered. A dichotomous mean 
field model has recently been developed describing the 
collective dynamics in such systems with uniform time 
delays near the bifurcation points. Here the theory 
is extended and applied to systems with nonuniform 
time delays. For strong enough couplings the systems 
exhibit delay-independent stationary states and delay- 
dependent oscillatory states. We find that the regions 
of oscillatory states in the parameter space are reduced 
with increasing width of the time delay distribution 
function; that is, nonuniformity of the time delays in- 
creases the stability of the trivial equilibrium. How- 
ever, for symmetric distribution functions the proper- 
ties of the oscillatory states depend only on the mean 
time delay. 
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1 Introduction 

The understanding of the collective dynamics in ex- 
tended stochastic systems with long range interactions 
is relevant for many domains in physics, chemistry, 
biology and even social sciences. A popular and ef- 
fective generic model for such systems is the globally 
coupled bistable-element-network, whose d ynamical 
prope rties have been st udied in the absence llZanettel 
Il997ft and presence fsee lGammaitoni et al.Ul998l and 
references therein) of noise and who se relevance for 
critical phenomen a l)Dawsonl Il983h. spin systems 
ll.Tung et allll992h. neural networks ll.Tung et all 1992: 
ICamperi and Wand ll99St iKoulakov et all I200S ), ge- 
netic regulatory networks ijGardner et al I l200rt) and 
decis ion making processes in social systems (|Zanettel 
has been pointed out. 
In recent years it has been realized that time 
delays arising, for example, from the finite prop- 
agation speed of signals are ubiquitous in most 
physical and biological systems. The effects of 
the delays on the behavior of yarious d ynam- 
ical systems have been studied 1 ZanetteL Ef 
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and some significant changes of 
the dynamical properties have been demonstrated 
llNakamura et allll994HBressloff and Coombesl Il998t 
IChoi and Hubermanl Il985|) . The effects of uniform 
time delays in globally coupled networks of phase 
oscilla tor s has been explored by lYeung and Strogat3 
l)l999|) . iTsimring and Pikovskvl l)200l|) studied the 
dynamics of a single noise activated, bistable ele- 
ment with time-delayed feedba ck. Combining the 
prope rties of these two systems iHuber and Tsimrind 
( 2003]) studied the cooperative dynamics of an ensem- 
ble of noisy bistable elements with delayed couplings 
and a mean field theory based on delay-differential 
master equations was developed. However, the the- 
ory assumed identical (i.e. uniform) time delays 
among all elements. Although for many s y stems 
this approximation is j u stified l(Salami et all [2003; 
IPaulsson and EhrenbergL [2001), most systems have 
distributed coupling delays. Thus, we study in this 
paper the generalized case of distributed time delays 
in a globally coupled network of bistable elements. 

2 The model 

Our generalized model for the study of noise-activated, 
collective dynamical phenomena in extended systems 
consists of N Langevin equations, each describing the 
overdamped noise driven motion of a particle in a 
bistable potential V — — x 2 /2 + x 4 /4, whose symmetry 
is distorted by the time-delayed couplings to the other 
network elements, 



,)+V2D£(t), (1) 



where are the time delays depending on the two 
coupled elements i and j. The strength of the feed- 
back is e and D denotes the variance of the Gaussian 
fluctuations £(f), which are 5-correlated and mutually 
independent (&(*)£,-(*')) = S(t - t')5 ir 

We use an Euler method to explore model nu- 
merically and focus our interest on the collective dy- 
namics of the bistable elements, i.e., on the dynamics 
of the mean field, X = N^ 1 YliLv 
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Figure 1. The critical coupling of the Hopf bifur- 
cation as a function of the noise strength D for dif- 
ferent a of the Gaussian time delay distribution with 
f = 100. The markers and the solid lines depict the 
critical couplings resulting from model Q and model 
(0), respectively. 



For e = 0, the elements are decoupled from each 
other. They randomly and independently jump from 
one potential well to the other. Therefore, in this case 
the mean field X = 0. For small |e|, the mean field 
remains zero. However, for a strong enough feedback 
the system undergoes ordering transitions and demon- 
strates multistability. That is, for a strong enough 
positive coupling the systems undergoes a pitchfork bi- 
furcation and adopts a non-zero stationary mean field 
X > 0, and transitions to a variety of stable oscillatory 
mean field states via Hopf bifurcations, are observed 
for strong enough positive and negative feedbacks. 

In the general case, model l|T]l. in which the time 
delays depend on both the "transmitting" and the "re- 
ceiving" element, cannot directly be described in terms 
of a mean field theory. However, the system becomes 
mathematically tractable if we assume that the time 
delay does only depend on the "transmitting" elements 
j, 

N 

±i = Xi - xl + ^ J2 x & - T i) + >/2££(*)- (2) 
4=1 

In order to check if such a simplification is jus- 
tified, numerical simulations of model Q and J5J are 
carried out and compared. In these simulations the 
distribution of the time delays is Gaussian, i.e., it is 
fully determined by its mean f and variance a. Fig. 
^ which compares the critical coupling strength of 
the Hopf bifurcation for different a, suggests that the 
above simplification is justified in order to study the 
stability properties of a bistable-element-network with 
time delays. 

This surprising result not only renders possible an 
analytical description of networks with distributed de- 



lays but also implicates that the number of operations, 
which have to be carried out to study such systems nu- 
merically, can be reduced from 0{N 2 ) to O(N). 

3 Dichotomous Theory 

In this section we derive the dichotomous theory for 
the description of globally coupled bistable-element- 
networks with distributed time delays. 

The dichotomous theory, valid in the limit of 
small coupling strength and small noise, neglects intra- 
well fluctuations of Xi. Thus, each bistable clement 
can be replaced by a discrete two-state system which 
can only take the values s\ t 2 — ±1. Then the collective 
dynamics of the entire system is described by the mas- 
ter equations for the occupation probabilities of these 
states ni^. This approach has been successfully used 
in studies of stochastic and coherence resonance (e.g . 
Mc Namara and Wiesenfeldl Il989t iGammaitoni et all 
1998tlJung et al.Lll992HTsimring and PikovskvU200l|) . 
and iHuber and Tsimrinel l(2003h used it to study the 
special case of a network with uniform time delays. 
They found that while away from the transition points 
the system dynamics is well described by a Gaussian 
approximation, near the bifurcation points a descrip- 
tion in terms of a dichotomous theory is more ade- 
quate. 

In order to apply the dichotomous theory to a 
network with distributed time delays, we coarse grain 
system (J2J . The coarse graining is accomplished as fol- 
lows: The range of possible time delays is divided up 
in M intervals I k {k = 1,2,..., M}. The size of the 
intervals A k is chosen, so that the number of bistable 
oscillators associated with a delay fitting in a particu- 
lar interval, is for each interval the same m = N/M. 
In this way oscillator groups are formed whose mean 
field can be expressed as, 

m £ — ' 

TjElk 

where h = [rfe, r k +i [, r k = J2i=i A/ and j = 1 . . . N. 

Assuming that A k <C f/a, where f and a are the 
mean and the variance of the time delay distribution, 
Eq. can then be approximated by, 

M 

x i =x i -x 3 i +-^-Yl Q k(t ~ r k ) + V2D£{t). (4) 
fc=i 

The dynamics of a single element Xi is determined 
by the hopping rates pi2 and P21, i.e., by the proba- 
bilities to hop over the potential barrier from s\ to S2 
and from S2 to si, respectively. In a globally coupled 
system, in which the time delays depend only on the 
transmitting elements, p±2 and P21 are identical for all 
elements and the master equations expressing the dy- 
namics of Eq. (0J in terms of occupation probabilities 
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read, 



where 



ni,k = -Pi2«i,fe +P2in 2 ,k 
n 2 ,k = Pi2"i,fc - P2iri2,k- 



(5) 
(6) 



The hopping pr obabilities Pi 2 . 2 1 are given by Kramers' 
transition rate ijKramerst ^940) for the instantaneous 
potential well, which for our system in the limit of 
small noise D and coupling strength e reads (cf. 
iTsimring and Pikovskvl 12001^ . 
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V2=F3 a 
2^T 



■ exp 



1 =F 4a 
AD 



(7) 



where a = (e/M) J2k=i &k(t - r k ). 

For large oscillator groups (m — ► 00), f2fc = 
«i,fcSi + «2,fcS2 = "2,fc - "-i,fc and nj.,*, + n 2 ,k = 1 
holds. With these terms, we can find the following 
set of equations: 

^fe(i) =Pl2 -P21 - {P21 + Pl 2 )Vl k (t). (8) 

The Jacobian matrix of this system is given through, 

/ai + b a 2 ... a M \ 
ai a 2 + b ... a M 



J = c 



\ ai 



(12 



(9) 



a M +6/ 



where c = - v / 2exp(-l/4£))/(4Af7rD), a k = e(3D - 
4) exp(-ATfc) and b = AMD. With this Jacobian the 
characteristic equation, determining the stability of 
the trivial equilibrium X = 0, becomes 
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(bc-Xf 1 - 1 L 






3=1 



-A = 0. 



(10) 



The trivial equilibrium loses its stability and under- 
goes a pitchfork bifurcation, describing the transition 
to a steady nonzero mean field, when the real solutions 
of the characteristic equation (i.e. the eigenvalues of 
the Jacobian) become positive. Thus setting A = 
and solving Eq. 1)11) [) for e yields the critical coupling 
for the pitchfork instability, 
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3D 



(11) 



A Hopf bifurcation indicating the transition to an os- 
cillatory mean field state occurs when the real part of 
the complex eigenvalues becomes positive. Therefore, 
the properties of the corresponding instabilities (i.e. 
frequencies and coupling strengths at the bifurcation 
points) can be found by substituting A = /i + ilu into 
Eq. , separating real and imaginary parts and set- 
ting n = 0. For the frequencies of the unstable modes 
we find, 

= -— exp(-l/4D)T^, (12) 



^ M M 

Is= sinwr fc' J c = J7 E cos^Tfc. (13) 



k=l 



k=l 



For large systems N — > 00, the number of groups M — > 
00 and thus 

00 00 

I s = J P(r) sin Lordr, I c = J P(t) cos ujtiIt, (14) 



where P(t) is the time delay distribution function. 

We can express the time delay dis tribution func- 
tion i n terms of cumulant moments K n ijVan Kampenl 
2003) and solve the integrals in (|14H : 

I s = sin(gi) exp(g 2 ), h = cos(#i) exp(g 2 ), (15) 
where 



9i = 



.92 



£.1 



(ilu 



,2m+l 



i(2m+ 1)! 

m=0 v ; 



K2m+1, 



E 



- (2m) 



-«2r, 



Consequently, 



j- = tan(gi). 



(16) 
(17) 

(18) 



Since for symmetric distribution functions all odd cu- 
mulant moments except the first one K\ = f are zero, 
Is/Ic — tanwf holds. That is, in the case of a sym- 
metric distribution of the time delays, the frequencies 
of the unstable modes in Eq. (|12J) depend only on the 
mean time delay. 

Let us now determine the critical coupling of the 
Hopf bifurcation. For large time delays f 3> tu {rk 
is the inverse Kramers escape rate from one well into 
the other) the low-order solutions of the transcendent 
equation (|12[) yield frequencies lu <C 1. Thus the real 
part of equation l|10|l can be linearized near lu = and 
the critical coupling of the Hopf bifurcation becomes, 



eh 



ADttuj 



(3D - A) (iV2exp(-l/4 J D)/ s - [l - ttluI c ) ' 

(19) 

Then, for large systems N — ■* 00 the critical coupling 
is, 

AD 

£H = F^c' (20) 

with I c = 3 sin(o;f) sin(5wtr/3)/(5cL;(T) and J c = 
cos(wr) exp(— uj 2 a 2 /2) for a uniform and a Gaussian 
distribution, respectively. 

Eq. l|12f> and l|20(l have a multiplicity of solutions 
indicating that multistability occurs in the system be- 
yond a certain coupling strength. 
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oscillatory states , 
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non-trivial stationary states 
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W*" ^ trivial stationary state 
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Figure 2. Phase diagram of the globally coupled 
bistable-element-network with uniformly distributed 
time delays derived from the theoretical model (solid 
lines) and numerical simulations of the Langevin 
model (markers) . The phase diagram is shown for dif- 
ferent standard deviations a of the delay distribution 
function. The mean time delay is f = 100. 
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Figure 3. The frequencies of the unstable modes 
at the bifurcation points resulting from the Langevin 
model (markers) and the the dichotomous model (solid 
line). For symmetric distributions the frequencies de- 
pend only on the mean time delay (see Eq. I12I and 



4 Results 

Eq. ijTT]) . l(T3j l and lj2TJ|) are used to determine the 
phase diagram and the frequencies of the unstable 
oscillatory modes / = ui /(2tt) of a bistable-element- 
network with uniformly distributed time delays 1 . The 
theoretical predictions are verified with numerical sim- 
ulations of the Langevin model (JTJ. The results are 
shown in Fig. [3 and Fig. El 

The figures show that near the bifurcation points 
the predictions by the dichotomous theory are reason- 
ably good for small noise (D < 0.3) and consequently 
in this regime the Langevin models |QJ and are 
dynamically equivalent. 

Fig. [21 also shows that the regions in the phase 
space where mean field oscillations occur are reduced 
with increasing width a of the time delay distribution 
function, meaning that nonuniformity of the time de- 
lays inhibits the occurence of Hopf bifurctions, i.e., 
increases the stability of the trivial equilibrium. 

In Fig. 01 the bifurcation diagrams including 
higher order solutions of Eq. (|12|l and (|20|l are pre- 
sented. This Figure shows that for a strong enough 
positive (e = e p ) coupling the trivial equilibrium 
loses its stability via a pitchfork bifurcation while 
for a strong enough negative coupling (e = £y_) a 
Hopf bifurcation determined by the primary solution 
of Eq. I|12|) an d 1|20[> occurs. The higher order so- 
lutions of these equations provide the multistability 
of the system. For a positive feedback several oscil- 
latory states with frequencies /& k/f are observed 
for e > = 1;2,...}. The transition points 

1 This should not be confused with uniform time delays, which 
means that the delay for each coupling is the same. 



are ordered as follows, < e st < < e H+ • ■ • 

If the feedback is negative, the system has oscilla- 
tory solutions with periods fi » (21 + l)/(2f) for 
e < e l R _ {I = 0, 1, . . .}, where > > • • ■ 
In the above annotation a (+/-) index means that the 
corresponding value is associated with a negative and 
positive feedback, respectively. 

5 Summary and conclusions 

We generalized a dichotomous theory based on delay- 
differential master-equations to account for the dy- 
namics of globally coupled networks of bistable ele- 
ments with nonuniform time-delays. As in the case of 
uniform time delays these systems possess a nonzero 
stationary mean field for a strong enough positive feed- 
back whose properties are time delay independent and 
a multiplicity of time delay dependent stable oscilla- 
tory states for both positive and negative feedback. 

For symmetric time delay distributions the fre- 
quencies of the oscillations depend only on the mean 
time delay. However, the critical couplings of the cor- 
responding Hopf bifurcations depend also on the width 
of the time delay distribution; that is, the critical 
coupling strengths and consequently the stability of 
the trivial equilibrium are increased for broadly dis- 
tributed time delays. This may be important for time 
delay systems such as neural networks and genetic 
regulatory networks, since the degree of time delay 
nonuniformity, which is often related to the diversity 
in the connectivity of the underlying network, affects 
the accessibility of the nontrivial dynamical states. 

The bifurcations of the trivial equilibrium are 
well described by the dichotomous theory in the limit 
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Figure 4. Upper panels and lower left panel: Phase diagrams of systems with uniformly distributed time delays, 
where f = 100 and a = 0, 10, 40. The dotted line depicts the critical coupling of the pitchfork bifurcation and the 
other lines depict those of the primary Hopf bifurcation as well as some higher order solutions (i.e. solution 1-16) of 
Eq. (|12J) and (|20J) . Lower right panel: The frequencies of the corresponding unstable modes which do not depend on 
<7, but slightly vary with the noise strength D. 
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of small noise and coupling strength. Far away 
from the transition points a theoretical description 
of the mean field dynam ics can be found u s ing a 
Gaussian approximation llDesai and ZwanzieL [l978; 
Hub er and TsimrineL 12003^ However, a theoretical 
approach for the description of the dynamics in the 
regime of strong noise near the bifurcation points is 
still lacking. 

This paper discusses the dynamics of globally 
coupled systems with time delays. It is assumed that 
all elements are coupled with uniform (i.e. identical) 
strength e. However, many networks have sparse cou- 
plings and nonuniform coupling strength, which may 
endow the system with a complexer dynamics. This 
issue will be discussed in an upcoming paper. 
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